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DIFFERENTIAL  GAMES  OF  SURVIVAL  WITH  SPACE-LIKE  TERMINAL  SET 


by 


Ronald  J.  Stern* 


Abstract 


For  differential  games  of  survival  in  which  the  boundary  may  be 
represented  as  a  smooth  curve  we  give  a  method  for  transforming  a  survival 
game  into  a  fixed  duration  game.   Comparisons  between  the  upper  and  lower 
values  of  the  original  game  and  its  transform  are  derived. 


*'Dept.  of  Business  Administration,  University  of  Illinois  at  Urbana. 
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DIFFERENTIAL  GAMES  OF  SURVIVAL  WITH  SPACE-LIKE  TERMINAL  SET 


1.  Introduction.   The  approach  to  differential  game  theory  used  in 
this  paper  is  that  of  A.  Friedman  C^l-[4^>   In  this  paper  we  give  a  procedure 
for  transforming  a  certain  differential  game  of  survival  into  a  differential  . 
game  of  fixed  duration,  and  derive  relations  between  the  upper  and  lower 
values  of  these  games.  We  restrict  our  attention  to  survival  games  in  Which 
the  capture  set  is  space-like-that  is,  its  boundary  can  be  represented  as 
a  smooth  curve  of  the  form  t=r(x).   These  results  lend  to  the  understanding 
of  the  inherent  structure  of  survival  games. 

In  section  2  we  give  the  requisite  preliminaries.   In  the  third  section 
we  give  two  results  concerning  d-games  which  are  needed  In  what  follows. 
The  transformed  game  and  the  main  results  are  presented  In  section  4.   Sec- 
tion 5  consists  of  examples. 

2.  Preliminaries.   Consider  a  system  of  m  ordinary  differential  equation' 

(2.1)  X  -  f(t,x,y,2)  (tol^lV 
with  an  Initial  condition 

(2.2)  x(to)  =  xq. 

n     Q 
Let  Y  and  Z  be  compact  subsets  of  the  Euclidean  spaces  R  and  R  res- 
pectively. The  controls  y(t)  and  z(t)  are  Lebesgue  measurable  functions 
taking  values  almost  everywhere  in  Y  and  Z  respectively,  defined  on  [t^.T^]. 
Let  F  be  a  closed  subset  of  R^   such  that 

(2.3)  F  3[Tj,»)»pr  for  some  t^  <  T^  <_  T^. 

Given  a  trajectory  x  -  x(t),  define  the  capture  time  as 


'•:t£.n 


0  r 

•'&&-X  '^S  ban     ;■■ 


'i^T^tf'ij   "•■*  hiifii'i»b  , 


w5  ^"       . 


(2.4)  t  =  t(x)  =  inf  [t:    (t,x(t))e  f} 

Consider  a  payoff  functional 

,t(x) 

(2.5)  P(y,z)  =  g(x(t)]   +  /  h(t,x,y,z)dt. 

The  differential  game  associated  with  (2.1)-(2.5)  is  called  a  game  of 
survival ,  denoted  G. 

Rjefn,ayk  1.   Survival  games  are  the  most  general  type  of  two  person,  zero- 
sum  differential  game,  i.e., 

(1)  If  g  "=  0  and  h  >^  0  then  G  is  a  game  of  generalized  pursuit-evasion . 
(ii)  If  g  =  0  and  h  =  1  then  G  is  a  game  of  pursuit-evasion . 
(iii)  If  F  =  [T  ,«»)xR™  then  t  =  Tq.  We  then  call  G  a  fixed  duration  game. 

The  following  assumptions  guarantee  the  existence  and  uniqueness  of  a 
solution  of  (2.1)-(2.2)  for  each  pair  of  controls  (see  [1]  and  [1]): 

(a)  f(t,x,y,z)  is  continuous  on  [tQjTg] x  R^x  yx  Z. 

(b)  There  exists  k(t)  e  L^(to,TQ)  such  that 

|f(t,x,y,z)|  <.k(t)(l  +  |x|) 


»m 


for  all  (t,x,y,z)  6-  [tQ,Tg]xR  xyxZ. 

(c)  For  each  R  >  0  there  exists  k^Ct)  e  L^(tQ,T  )  such  that 

|f(t,x,y,z)  -  f(t,x,y,2)|  <  kj^(t)|x  -  x| 
for  all  t  €•  tt|^,Tp],  y  ^  Y,  z  €•  Z,  [x|  £  R  and  |x|  £  R. 

Regarding  the  payoff  we  state  the  following  assumptions: 

(d)  h(t,x,y,z)  is  continuous  on  [t  ,T  1  x  R  x  yx  Z. 

(e)  g  is  continuous  on  R  . 

If  (a)-(e)  hold  then  P(y,z)  is  well  defined  on  the  space  of  controls. 

T  -  to 
Let  n  be  any  positive  integer,  and  6  =  .  Let 


Ij   =   (tj_j^,tj)      for  t^   =   tg  +  j6,        1  1  J  1  n. 

Define  Y.   and  Z.   to  be  the  classes  of  measurable  functions  on  I.  which  almost 
J  J  j 

everywhere  take  values  in  Y  and  Z  respectively. 

Let   r    '^  be  any  map  of  Z.  x  Y^  x  2^  x  Y^  x..  •   xY        xZ,    into  Y   .      We   then 


call  the  n-tuple 


r"^  ==  (r^'\,...r'^'") 


an  upper  6-strategy  for  y.   Similarly,  we  define  an  upper  6-strategy  for  z, 

A  ,  whose  components  A  '-^  are  maps  from  Y  x  Z  x  Y  x  Z  x  •••  x  Z  .  x  Y.  into  Z  . 

For  (2  <  i  <  n)  let  r„  .  be  any  map  from  Y,  x  Z,  x  Y- x  Z. x  .. .  x  Y,  ,  x  Z .  , 
—   —        6, J  lizz        j-1   j-i 

into  Y . ,  and  let  r .  ^  be  any  element  of  Y^ .  We  then  call  this  n-tuple 

^6=  <^6.r---'^6,n> 
a  lower  6-strategy  for  y.  Analogously  one  defines  a  lower  6-strategy  A.  for  z, 

Given  a  pair  (^r,r  )  we  uniquely  obtain  control  functions  (Zr»y  )»  and  a 
trajectory  x  .   (z-,y  )  is  called  the  outcome  of  (^r,r  ).  Analogously,  a 
pair  (r.,A  )  yields  an  outcome  (y^jZ  )  and  a  trajectory  x.. 

The  upper  6-value  of  G  is  the  number 

V^(G)  =  inf  fup  inf  sup...  inf  sup  P[A.,r^], 

A^  ,  T^'^  A-  ,  r"5'^  •  A,   r^»''   * 

0,1       6,2         6,n 
and  the  lower  6-value  of  the  game  is  defined  by 

V~(G)  =  sup  inf  sup  inf...  sup  inf  P[rj,,A  ]. 
^6,1  ^    ^6,2  ^      ^6,n  ^ 

We  say  the  differential  game  has  value  V(G)  if  the  limits  lim  V»(G) 

6^0      "^ 

=  V"(G)   and     lim  v'^(G)   =  v"^(G)   exist  and  are  equal.      V~(G)   and  v"*'(G)   are 

6-»-0 

the  lower  and  upper  values  of  G,  respectively. 

Proof  of  the  following  theorem  may  be  found  in  [2.]: 

Theorem  2.1.   Let  (a)-(e)  hold.   Then 


'■■■',  ' 


■.'    . :,!'  ' 


'I!)!;' 
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(2.6)  V*(G)  =  inf  sup  P[Ag,r'^]  =  sup  Inf  P[A^,r*], 
ana  '^''  ''       '« 

(2.7)  V.(G)  =  sup  inf  P[r.,A  ]  ■=  inf  sup  P[r.,A  ]. 

r,  A^    '      A^  r, 

Some  further  assumptions  now  will  be  stated. 

(f )   F  has  C^  boundary  3F  and 

m 
V.  +  min  max  I     v  f  (t,x,y,z)  <  0; 
Z   Y  j=l  ^  ^ 

(2.8)  ■■  r. 

V.  +  min  max  I     v  f  (t,x,y,z)  <  0 
Y   Z  j^'l  ^  ^ 

for  all  (t,x)  e  9F,  where  v  =  (Vg,v^,...,v  )  is  the  outward  normal  to 

at  (t,x),  and  the  f.  are  the  component  functions  of  f. 

(g)  max  min|f(t,x,y,z).p+h(t,x,y,z)j=  min  max[f (t ,x,y,z).p4h(t,x,y,z)^ 
for  all  p  r"*. 


Theorem  2.2.  Let  (a)-(f)  hold.  Then 
(i)  V  (G)  and  V  (G)  exist, 
(ii)   If  also  (g)  holds  then  G  has  value. 

The  proof  of  (i)  follows  from  arguments  in  [2],  in  particular  sections 
3.3,  5.2,  and  problem  3.4.3,.   (il)  is  proven  in  [3].for  the  case  when  G  is 
of  fixed  duration.   Extensions  of  the  results  of  [3]  found  in  [4]  yield  (ii) 
for  the  general  survival  case. 

Remark  2.   In  (ii)  of  Theorem  2,2  we  can  weaken  (f)  by  writing  (2.8) 
with  a  "max  rain"  instead  of  a  "min  max".  We  reauire  the  stronger  condition, 
however,  for  (ii). 

Ill 


(.■^■^ 


;r( ' 


■:  3'  y 


3.  Two  L|£mmas  ,0)n  6-Gam^s. 

y  6 

Definition  1.   B^  is  the  class  of  F .  such  that  for  any  A  the  y-out- 

6  2 

come,  y.,  of  (r-,A  )  is  a  Bore 1-me as ur ab 1 e  function.  B.  is  defined  similarly. 

Lemma  ,3,.,jL.  Let  G  be  a^  game  of  survival  satisfying  (a)-  (e) .  We  then 
have 

(3.1)  V*(G)  =  inf^  sup  P[A.,y], 
and 

(3.2)  V.(G)  =  sup  inf  P[r-,z]. 

r.eB^  z  ^  ■     . 

0   0 

(Here  "sup"  means  the  sup  taken  over  all  admissible  controls  for  the  player 

y;  similarly  for  "inf.") 

z 

Proof.   From  Theorem  2.1  it  is  easily  seen  that 

(3.3)  V'^(G)  =  inf  sup  P[A.,y], 

^   y        ' 

and 

(3.4)  V^(G)  =  sup  inf  P[r^,2]. 

^&     ^ 

We  will  use  (3.3)  to  prove  (3.J).   (3.2)  will  follow  similarly  from 
(3.4). 

Let  E  >  0  be  given,   llien  (3.3)  implies  the  existence  of  L.   such  that 

0 

(3.5)  V^iG)   >  P[A^,y]  -  e 
for  all  controls  y  =  y(t). 

Given  any  Lebesgue  measurable  function  r  valued  in  R  on  an  interval  I, 
there  exists  a  Borel  measurable  function,  say  b[r]  which  agrees  with  r  almos*: 

everywhere  on  I.  We  will  use  the  above  fact  in  order  to  modify  A-  into  A- 

z 
which  is  a  member  of  B-. 

0 


.&>; 


;  J  ;••..''    :      I'  O,! 


-IfiiiKt 


.r»v' 


5,     '  ;  ?.i-^if"   >■'■'> 


Let  y  =    (y, ,y„,.-.,y   )  be  any   control   for  player  y.      Define 

A.   .    =  b[2,]     where     z.    =»  A.   , 

0,1  1  1  0,1 

A^   2^^1'^1^   '^  ^[z^]     where     z^  =  A^  2^^!'^!^ 

^,j^^i'yi'^2'y2'---'^j-i'yj-i>  ^  ^^^j^ 

where  z     =  A^      (z  j,  ,y^  ,Z2,y2, .  . .  t^.j^fJ.^)    for  2  j<  j   j<  n. 

Define  A^  =    (A.   _ ,A,   „,.... A.     ).      It  is  not  difficult  to  see  that 
o  0  ,i      0  ,z  o  ,n 

P[A^,y]   =  P[A^,y] 

for  all  controls  y.   This  fact  and  the  fact  that  e  in  (3.5)  was  arbitrary 

yield  (3.3).   (3.4)  follows  similarly. 


De^,:^ni,t,ion  ^.   S^  is  the  class  of  F.  such  that  for  any  A  the  y-outcome, 

6  z 

y^ ,  of  (r.,A  )  is  a  step-function.   S.  we  define  similarly. 

Lepp^a^  ,3,. 2.   Let  G  bje  a_  game  of  fixed  duration  satisfying  (a)-(e) .   We 
then  have 

(3.6)  V^(G)  =  inf  ,  sup  P[A.,y], 
and 

(3.7)  V  (G)  =  sup   inf  P[r  z]. 

Proof.   Let  y  >  0  and  a  >  0  be  given.   Given  any  Lebesgue  measurable 
function  r  valued  in  R  on  an  interval  I,  there  exists  a  step  function  8[r] 
and  a  measurable  subset  J  C  1   such  that 

is[r]  -  r|  £  Y    for  all  t  €  I  -  J 
and  meas.  J  <^  a. 

We  will  prove  (3.6),  the  case  for  (3.7)  being  similar.   Let  A^  be  as  in 
the  proof  of  Lemma  3.1,  where  e  >  0  was  given.   Proceeding  as  we  did  there, 
we  can  define  a  lower  6-strategy  A-  with  the  following  property:  Given  any 


control  y  there  exists  a  measurable  set  J  c  ItQ,T„]   such  that 

(3.8)  |z^   -  z^l   1  Y  for  all   t  e   I  -  J, 
and 

(3.9)  meas.    J  £  na, 

where   z.   is   the  z-outcome  of    (A.,y)   and  z.  is   the   z-outcome  of    (A,,y).      We 
claim  that 

(3.10)  |p(y,i^)   -  P(y,z^)!    <     0(Y,na) 

for  a  positive  function  0(*,")  which  does  not  depend  on  the  control  y  and 
tends  to  0  with  its  arguments. 

(3.10),  (3.5)  and  the  arbitrariness  of  e,  y  and  a  will  yield  (3.6).  Thus 
it  remains  to  establish  (3.10)  from  (3.8)  and  (3.9).  We  will  show  that  for  a 
positive  constant  C 

(3.11)  sup   |x.  -  X. I  £  C(y  +  na), 

te[t,,T^] 

where  x^,  is  the  trajectory  associated  with  (A.,y)  and  x.  is  the  trajectory 

associated  with  (Aj,,y).   Verification  of  (3.10)  is  then  quite  routine  upon 

o 

making  use  of  the  continuity  of  h.  To  verify  (3.11)  we  write 

(3.12)  [x.  -  x.|  =  |f(t,x  ,y,z  )  -  f (t,x.,y,z»)| 


v^,       ,^V^,^^, 


1  [f (t.x^.y^z^)"  f (t,x^,y,z^)| +  [ f (t ,Xg,y,z^)  -  f (t.x^.y.z^) 

From  (3. 8), (3. 9),  the  continuity  of  f,  the  fact  that  the  family  of  tra- 
jectories of  G  is  uniformly  bounded,  and  condition  (c)  of  section  2,  we  have 
the  existence  of  a  positive  constant  JB  and  a  positive  integrable  function 
k(t)  such  that 
(3.13)       |xg  -  x^.|  1  B(y  +  na)  +  k(t)|i^  ~  ^6  I  • 

From  a  fundamental  inequality  of  differential  equations  (see  [l],p.37) 
we  then  obtain 


/^O  k(t)dt 
(3.14)  sup    |x.  -  x.|  <.  B(y  +  na)e  ° 

te[t,.T„] 

completing  the  proof. 

4.  Transfonne(3  Survival  Gameg..   Let  G  denote  the  game  of  survival  in- 
troduced in  section  2.  Let  Rq  denote  a  uniform  bound  on  the  family  of  tra- 
jectories for  G,  Let 

c  =       max  |f (t,x,y,z) { . 

[to,TQ]x{|x|  <.Rq}xYxZ 

We  will  require  the  following  condition  in  much  of  what  follows: 

(F  )  9F  is  represented  by  an  equation  t  =  r(x)  where  r  is  continuously  dif- 
ferentiable  on  {jxj  <^  R  }  and  is  piecewise  twice  continuously  dif ferentiable 
on  {jx|  £  Rf.}.   Furthermore  the  gradient  of  r  satisfies 

max    |r  (x)|  <  -  . 

Remark  3_^  An  elementary  argument  shows  that  (F  )  Implies  (f) 
of  section  2. 

We  now  define  a  certain  coordinate  transformation  (t,x)  ->  (t',x')  which 

transforms  3F  into  the  surface  t'  =  rCx^),  via  the  relations 

(4.1)  t'  =  t  +  r(xQ)  -  r(x) 
and 

(4.2)  x'  =  x. 

Let  y(t)  and  z(t)  be  a  given  pair  of  control  functions,  and  let  y^t)  be 
the  corresponding  trajectory.   Using  the  above  transformation,  let  us  write 

(4.3)  (t,x(t))  ^  (t',x'(t')). 
Define 

(4.4)  t'(t)  =  t  +  r(xo)  -  r(x(t)). 

Notice  that  x(t)  =  x'(t'(t)). 


T.p.mpfl  4.1.   Let  G  satisfy  (a)-(e)  and  (F  ) .   Then  the  following  all  hold; 

(i)   t'(t)  is  strictly  monotone  increasing  on  [tQ,Tg]. 

(ii)  x'(t')  is  uniformly  Lipschitz  continuous  on  [tQ,r(xQ)],  and  thus 

is  dif ferentiable  almost  everywhere  on  [tQ^rCx^)]. 

(iii)  At  almost  every  t'  €■  [tQ,r(Xg)]  we  have 

dx'(t') 
dt' 

f(t'  -r(xo)  H-r(x'(t')),x'(t'),y(t'-r(xo)  +r(x' (f)))  ,2(t '  -  r  (xq)  +  r(x' (t*)))) 
1  -r^(x'  (t'))-f  (t'-r(x^+^^))  ,x'  (tO.yCf -r(x^+r(x'(t'))),z(t'-r(xQ)+r(x'  (tf)J) 

(iv)  P(y,z)  =  g(x'(r(Xjj)))  4- 

/  ^h(t'  -r(xo)+r(x'(t')),x'(t'),y(t'  -  r(xo)  +  r  (x' (f  )))  ,z  (t'  -  rCxp)  +  r(x' (t ' ))))    , 
^0  1-  r,(x'(t')>f(t'~r(x^+r(x'(t')),x'(t'),y(t'-r(Xjj)+r(x'(t'))),z(t'-r(xQ)+r(x'(t^)))) 

Proof.  Let  t„  >  t.,  where  t_  and  t,  are  in  the  interval  [t^.T^].  We  have 

(4.5)  |r(x(t2))  -  r(x(tp)|  <  c  max   jr^(x)  |  (t^  - 1^)  <  t^  -  t^ , 

by  (F  ).   This  proves  (i). 

Let  tj  and  t'  be  in  the  interval  [tg,r(x  )].   We  have 

(4.6)  |x'(tp  -x'(tp|  -  |x(t^-r(xQ)+r(x'(tp))  -  x(t;  -  r(xQ)  +  r(x' (t^)))  | 

<c|t:-t;|+c     max        |r^(x)|-|x'(t')   -  x'(tn|, 
and  therefore 

(4.7)  !x'(t;)  -  x'(t:)|  < — TT-rrlt^  -  t,'|. 

^  '  2'  l'—     1-c     max  r    (x)    '    2  1' 


i!x|lRo> 


Tl- 


This  proves    (ii) . 

We  have ,  by  the   chain  rule , 

(4.8)  ^d^=  fp-^'(^'^^>>dF  '^'^'^^ 


^-x'(t'(t))  ^ 


1-r    (x(t)).^-^ 


Straightforward  substitutions  now  yield  (iii)  and  (iv) ,  completing  the  proof. 


h   :     (5:     ;    ;, 
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Define  now  the  following  functions: 
f '(t',x',y',2')  =  ^^^'   -'^(^o^  H-r(x'),x' ,y' ,z') 

^,,,,   ,   ,   ,,     h(t'  -r(xo)  +  r(x'),x',y',z') 
h'(t' ,x' ,y' ,2')  = 


1  -r,(x').f(t'  -r(xo)+r(x').x',y'.z') 

We  now  will  define  a  certain  game  of  fixed  duration;,  G'.   The  dynamics 
of  G'  are 

(A. 9)  ^=  f(t',x\y',z') 

with  initial  condition 

(4.10)  x'(to)  =  Xq. 

The  payoff  is  given  by 

rCxg) 

(4.11)  P'(y',2')  =  g(x(r(X(,)))  +  /     h'(t',x',y',2')dt'. 

Lemma  4.1  implies  that 

(4.12)  P(y,z)  =  P'(y',2') 
where 

(4.13)  y(t)  =  y'(t'(t));   z(t)  =  z'(t'(t)). 

Theorem  4.1.   Let  G  satisfy  conditions  (a)-(e)  and  (F  ) ,  and  let  G 
satisfy  conditions  (a)-(e).   Then 

(4.14)  V~(G')   <  V'^(G) 
and 

(4.15)  V"(G)  £V"^'(G'). 

Proof.  We  will  give  the  details  for  the  proof  of  (4.14).  The  proof 
of  (4.15)  is  similar. 

Let  n  >  0  be  such  that 

(4.16)  max   Ir  (x)|  <  -  +  n- 

{|x|<R„}   -     -c 


11 


Let  6  =  and  6'  =  j -,  where  n'  and  n  are  taken  to  be 

such  that 

(4.17)  (3  +  cri)6  <  6'. 

Since  the  upper  and  lower  va3.ues  of  G  and  G'  are  guaranteed  to  exist, 
by  Theorem  2.2,  (4.14)  will  hold  if  it  can  be  proven  that 

(4.18)  sup   inf  P'[r^,,z']  1  inf  ^  sup  P[A^,y]. 


r^,^sy,   z'  A^eB,  y 


Let  r  ,  e   S^,  and  A.  €•  B^  be  arbitrary.   (4.18)  will  hold  if  there  exist 
controls  z'  and  y  such  that 

(4.19)  P'[rg.,z'l  =  P[Ag.y]. 

Let  y'  denote  the  y-outcome  of  (F  ,,z')  and  let  x'  denote  the  corres- 

0 

ponding  path.   Let  z  denote  the  z-outcome  of  (A  ,y)  and  x  the  corresponding 
path.   Suppose  we  can  construct  z'  and  y  such  that 

(4.20)  z'(t'(t))  =  z(t)  t  t  [to,To] 
and 

(4.21)  y'(t'(t))  =  y(t)  t  er   [tg.Tg] 

where  t'(t)  =  t  +  r(xQ)  -  r(x(t)). 

By  Lemma  4.1  we  then  would  have  (4.19),  which  is  all  we  require. 

Denote  the  intervals  of  game  G  by  I  ,  j  =  l,...,n,  and  denote  the 

intervals  of  G'  by  I'.,,  j'  =  l,...,n'.   Here  I^  =  (t^  ,,t^)  and  I',  = 

3  J     j~l  J       j 

The  component  r.,   of  r.,  determines  y'(t')  on  I',  and  this  is  a  step 

function  given  by 

k 
y'(t')  =  I  c    -J;    . 
i=l  ^'^   ^i,l 

Here  ^  is  the  characteristic  function  of  C   ,  i  =  l,...,k.   The  C 

1,1  ^'1  ^'^ 
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are  disjoint  intervals 


such  that 


^i.l  ~  ^*^i-l'^i,l^ 


i=l  ^' 


i  =  n- 


Here  t'   =  t.  and  t,'   =  t'.  The  c.  ,  are  constants. 
0,1    0      k,i    1        i,l 

The  component  A.  ,  of  A.  determines  z(t)  on  I,.  We  will  now  construct 

0,16  •!• 

y(t)  on  I-^,  making  use  of  the  trajectory  x(t)  as  it  evolves. 
By  Lemma  4.1  (i)  we  can  define  the  following: 


t(t'  ^)  =  the  unique  t  such  that  t'  ^  =  t  +  rCxg) 
Now  define  the  following  function  on  I.: 


r(x(t)), 


(   c. 


(4.22) 


y(t)  =  J 


\^^       for  to<t<t(t;^^) 

,1   ^"'^  ^<^I,i>^'^l'^(^2,r 


c  ,   for  t(t'  ,  -)  <  t  <  t, 
p,l  p-1,1  -   -  1 


where  p  <  k  due  to 


and  (4.17), 

The  inequality  (4.23)  follows  from 

(4.24)      t(t;^3)  -  t(t^„3^^p  =  t!^^  -t^_^^^  +  r(x(t(t'^^)))  -r(x(t(ti_^^3^))) 

and  assumption  (F  ) . 

Thus  y(t)  has  been  constructed  on  Is  by  using  y'(t')  on  only  the  first 
part  of  the  interval  Ij . 

The  map  A.   gives  z(t)  on  I2.   We  continue  id  the  above  manner  until 
y(t)  has  been  constructed  up  to  time  t(t'  ^),  which  occurs  in  some  interval 


•i    -i 
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I  ,  m  >  1.   In  the  construction  we  made  use  of  the  maps  A,  ,,  i  =  1 m, 

m  "^        <S>j       >    ♦  » 

and  the  trajectory  x  up  to  time  t(t/  ^) . 

We  now  use  z(t),  t  e   [t^^tCt^^  ^)]  to  define  z'(t')  on  [t^.t'   ],  as 
follows : 
(4.25)  z'(t')  =  z(t'  -  r(xg)  +  r(x(t(t'))))      t'  6  Ij  . 

The  Borel  measurability  of  z  implies  that  z'  thus  defined  is  a  measurable 
function. 

Thus,  y(t)  is  constructed  on  I,  sl^j* . .  ,Ig, ,  and  z'(t')  is  constructed  on 
l!.  We  continue  in  this  fashion  until  t  =  t,  which  implies  t'(t)  =  r(xQ). 

The  controls  which  have  been  constructed  can  be  seen  to  satisfy  rela- 
tions (4.20)  and  (4.21),  completing  the  proof  of  (4.14).   The  proof  of  (4.15) 
is  analogous  to  the  arguments  above. 

Remark  4.   By  Theorem  4.1  it  is  clear  that  If  both  G  and  G'  have  value, 
then  their  values  are  equal. 

5.,  Ex^ples.  We  consider  two  special  cases  of  G  in  this  section. 

Epcample  1_.     Let  G  be  a  game  of  pursuit-evasion.      It   follows  that  In  this 
case  we  have 


(5.1)  P'(ySz')  =  /  "^^ 


'j.  l-r,(x')>f(t'  -r(xo)  +  r(x'),x',y',z') 


Suppose  G  has  value,.  We  immediately  obtain  the  following  estimate  for 

V(G): 

(5.2)  max  min  min  h' (t '  ,x' ,y '  ,z' )  £ —j;^ — 5  ^  ■ 

Y   Z  [t„,r(x,)]xi|x|<Ri!  '^'•^0^"''0 

<^  min  max  max  h'  (t '  ,x'  ,y'  ,z'  ) 

Z    Y  [t„,r(Xo)]xilx|<R;! 


m.  .  ■  ■ , ' 


-^  L-:fT 


V      .  '-',       3-.> 


ih 
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where  h'  is  the  integrand  in  (5.1)  and  R'  is  a  bound  on  the  trajectories 
for  G'. 

E3c;ample  2.   Suppose 
(5.3)  h(t,x,y,z)  =  k  -  r, (x) •£ (t ,x,y,2) 

where  k  is  constant.   For  purposes  of  estimating  V(G)  we  can  without  loss 
of  generality  take  k  =  1.  Then  G'  is  a  fixed  duration  game  with  only 
terminal  payoff.   If  (5.3)  holds  and  g  =  0,  then  P'(y',z')  =  r(xQ)  -  tg 
for  any  pair  of  controls  (y*,z'). 

Afikjo^owledgTmeiit^ .   The  author  thanks  Avner  Friedman  and  Richard 
Scalzo  for  their  stimulating  comments. 


REFERENCES 


[ij  CODDINGTON,  E.  and  LEVENSON,N..  Theory  of  Ordinary  Differential 

Equations ,  McGraw-Hill,  New  York  1955. 

[2]     FRIEDMAN,  A.,  Differential  Games.  Wiley- Interscience,  New  York,  1971 

[3]    FRIEDMAN,  A.,  "Upper  and  Lower  Values  for  Differential  Games", 
J.  Differential  Equations  (12),  1972. 

[4]    FRIEDMAN,  A.,  "Remarks  on  Differential  Games  of  Survival",  forthcoming. 


REFERENCES 


[l]    CODDINGTON,  E.  and  LEVENSON,N.,  Theory  of  Ordinary  Differential 
Equations.  McGraw-Hill,  New  York  1955. 

[2]     FRIEDMAN,  A.,  Differential  Games.  Wiley- Interscience,  New  York,  1971 

[3]    FRIEDMAN,  A.,  "Upper  and  Lower  Values  for  Differential  Games", 
J.  Differential  Equations  (12),  1972. 

[4]    FRIEDMAN,  A.,  "Remarks  on  Differential  Games  of  Survival",  forthcoming. 


J 


0^,-m 

^ 


